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[57] ABSTRACT 

The apparatus and method for evaluating images for quality 
assurance parameters of ultrasound image scanners are 
described. The apparatus includes a digital computer with 
display output, a video frame grabber or direct image 
read-out interface from ultrasound scanner, a digital storage, 
and software. Using a transducer, an ultrasound scanner 
produces an image, of test objects or phantom, that is 
temporarily stored in scanner memory. The phantom image 
is transferred to the memory of the processing computer 
either by digitizing the video output of the scanner or 
reading directly by digital means from the scanner. The 
software enables the user to acquire the image by the above 
means; associate the images with information on scanner, 
operator, and expected performance standards and accura- 
cies. As selected by user, the software evaluates scanner 
performance parameters and produces quantitative results, 
graphs, and reports for screen display and printer. The 
processed and inputted information is stored with the mea- 
surement set and images for future access. The software 
generates, using stored and current results, trend graphs of 
evaluated performance parameters. 

20 Claims, 14 Drawing Sheets 
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Figure 1. 3\ock Diagram of Typical Apparatus 
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Figure 2. Processing of "Phantom Image" 
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Figure 3. Parameter Evaluation Procedure 
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Figure 4. General Schematic-Inputs 
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Figure 5. Phantom Test Objects 
Phantom 200 
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Figure 6, General Schematic-Outputs 
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Figure 7: Display Example 
In Operation 
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Figure 8>. Example of Object Profile 
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Figure 9. Typical Evaluation Operational Flow Chart 
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Figure 10. Typical Reports and Trends Operational Flow Chart 
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Figure 11. Typical Processing Menus 
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Figure 12: Typical Dialog for Database Acceee — In Operation 
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Figure 14. Typical Performance Parameters Entry Dialog In Operation 
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Figure 16. Ultrasound Scanner Performance Report 
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METHOD AND APPARATUS FOR 
EVALUATING SCANNERS 

FIELD OF THE INVENTION 

The present invention relates to the evaluation of ultra- 
sound images. In particular, the invention applies the pro- 
cessing of ultrasound scanner images for performance evalu- 
ation of scanner, transducers, phantoms and scan techniques; 
includes screen display and print out on paper of graphs, 
images, results and reports; includes storage, backup, copy 
and retrieval of all above information objects. 

DISCUSSION OF BACKGROUND 

An ultrasound image is produced by sending ultrasound 
pulses or waves of energy into a reflecting medium and 
collecting the reflected energy using specialized transducers 
applicable to clinical diagnostic imaging needs. Reflected 
energy is transformed into images, consisting of grayscale 
value at a depth and distance inside the medium. Shape and 
grayscale or halftone values of the image define the objects 
and background inside the medium. The image is frozen and 
displayed by a monitor connected to the ultrasound scanner. 
Scanner electronics output the image information as a stan- 
dard video or in a digital format. Image output in video 
format is converted and saved into digital form by a frame 
grabber of sufficient quality. Image in digital format is read 
into processing computer memory and stored into hard drive 
or storage media. Image is displayed from computer 
(desktop, laptop or notebook) on a grayscale display screen 
or monitor. 

Test objects made of tissue-mimicking materials called 
Ultrasound phantom" are available in the market to produce 
images to simulate liver tissues, cysts and tumors. In addi- 
tion these include ultra-small high reflectance and low 
reflectance test objects to reveal fundamental instrument 
properties of ultrasound scanner system Typical phantom 
objects are sketched in FIG. 5. The phantom is scanned 
using transducer 116, to produce images of the phantom test 
objects. Images are frozen and temporarily stored in scanner 
memory. In current quality assurance (QA) practice, these 
images are printed on a dedicated film camera using video 
output of the ultrasound scanner. 

Subjective analysis is performed using the film image and 
results are manually documented to produce quality assur- 
ance reports. However, distance measurement for a selected 
object can be obtained, one at a time, with the aid of 
scanner's built in calipers, by visually selecting distances 
such as diameter of a phantom object such as vertical pin 
102 on the scanner's display. Phantom objects are displayed 
as grayscale image, with as many as 256 shades between 
black and white. It is not possible to accurately determine 
spatial extent of such a displayed object by visual means. 
Current subjective methods do not permit any accurate 
verification of scanner imaging performance parameters 
either in production or operational settings. 

It is important to evaluate scanner system as whole, 
including transducers, gain controls and imaging electronics 
from output image signals. Objective scanner quality per- 
formance evaluation is essential for manufacturing produc- 
tion line, quality assurance audit, for operational installa- 
tions and for regular periodic maintenance. Quantitative 
performance evaluation is necessary to calibrate or service 
the scanner system after breakdowns to achieve reproducible 
imaging performance. 

The present invention will be useful for: ultrasound 
scanner manufacturers; quality assurance professionals and 
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consultants in industry; hospitals and clinics; and service 
engineers. Ultrasound images are used to diagnose several 
abnormalities or disease conditions in humans and animals. 
In industry, ultrasound imaging is used for nondestructive 

5 testing (NDT) of fluid filled pipes, cracks in welds of 
material joints etc. 

The present invention is applicable to identify the actual 
variations in performance of a scanner system in relation to 
various methods of scanning, and variety of transducer 

10 designs. Thus, this apparatus is a valuable tool for research. 
Quality assurance methods are an integral part of any 
teaching programs in ultrasound imaging curriculum and 
quantitative approaches to performance evaluation will 
enhance knowledge of scanners. 

15 Using a laptop or notebook computer hardware, will 
render this apparatus portable, convenient for evaluating 
scanners at different locations. 

SUMMARY OF THE INVENTION 

20 

The present invention is an apparatus for evaluating an 
ultrasound scanner, comprising: a processor, a storage 
device, at least one output device, at least one input device; 
and software means operative on the processor for: 
2 S (a) maintaining in the storage device information on the 
scanner; 

(b) maintaining in the storage device information regard- 
ing expected performance standards; 

(c) maintaining in the storage device information regard- 
30 ing at least one phantom test object; 

(d) inputting via said at least one input device; 

(e) interactively specifying said at least one phantom test 
object in image for processing; 

(f) processing said specified phantom test object in image 
to quantitatively determine the characteristics of said 
scanner; 

(g) maintaining in the storage device results of said 
processing; and 

40 (h) outputting via said at least one output device results of 
said processing. 
Software means incorporate methods of interactive and 
automatic evaluation of medical images to produce quanti- 
tative parameters, graphs, trends of parameters and reports 

4 5 related to the characteristics of image. The information 
stored and processed by software means consists of: (1) a 
database table to include information on ultrasound scanner 
and transducers, (2) a table to include information on the 
phantom (test object) design features, (3) a table to include 

50 expected performance standards information, (4) a means of 
storing and associating the images and the above tables or 
information, (5) a means of relating user provided and 
default processing information to images, and all of the 
above information, (6) a user interface that lets user process 

55 images for visual enhancement, permits to specify region of 
objects for processing, select type of evaluation and 
processing, vary processing parameters, select graphs, and 
hard copy outputs such as printout on paper and film, (7) a 
means to copy or retrieve, all information above, and (8) 

^ on-line help. 

BRIEF DESCRIPTION OF THE DRAWINGS 
AND FIGURES 

FIG. 1 is a schematic of an apparatus used for evaluating 
65 ultrasound scanner image quality by the present invention. 
FIG. 2 is a flow chart depicting component steps involved 
in processing of phantom images by the present invention. 
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FIG. 3 is a flow chart of procedures of the present apparatus uses graphic user interface consisting of dialogs, 

invention for evaluating characteristic parameters of ultra- pull-down menus, buttons, on-line instructions and on-line 

sound scanners by processing phantom objects. help. 

FIG. 4 is a schematic of various information inputs of the Ultrasound scanner test objects called "phantoms" are 

present invention 5 made of tissue-mimicking materials. Phantoms are commer- 

FIG. 5 is an iilustration of typical ultrasound phantom ^ "S* Me to T pK S? ^ ^ 

f w cvsts and t™ 018 * 111 addition, these include ultra-small high 

consisting or test objects. reflectance test objects, in FIG. 5, to determine fundamental 

FIG. 6 is a schematic of various information outputs of the imaging properties such as spatial resolution, of ultrasound 

present invention. 1Q scanners. Characteristics of these image objects are calcu- 

FIG. 7 is an illustration of typical display output of the lated using specific algorithms. Images are produced by 

present invention in operation. scanning particular face 115 and inputted to processing 

FIG. 8 is a sketch of a typical object gray value profile ST >uter ^ of * e »F*? b <>f acquisition 8 or 9 in FIG. 

used for processing in the Resent invention } ^ * 6 from ««ed information in FI& 

* & v 4 or imported 7 mto this apparatus from different image and 

FIG. 9 is a flow chart depicting typical evaluation proce- 15 information storage formats, 
dures of the present invention in operation. ^ outputs are described schematically in FIG. 6. Appa- 

FIG. 10 is a flow chart consisting of typical reports and ratus offers facilities to copy 12 all of the data including 

trends of the present invention in operation. images onto a digital media such as disk or tape or export 13 

FIG. 11 is an illustration of typical processing menus of data m different digital formats. Ultrasound Performance 

the present invention in operation. 20 Evaluation reports 14 can be printed out automatically for 

HO. 12 is an illustration of a typical dialog for accessing e f ch scanner i(knu^ing every ultrasound fransducer param- 

... ... 4 . B eters individually. Reports also indicate whether the param- 

information databases of the present invention in operation. eterg m QUtsid( f me ^ as spedfied m ^^y^^ 

FIG. 13 is an illustration of a typical dialog for accessing information 5 and Phantom Information 2. All of the data 

processing tasks of the present invention in operation. 2 5 and calculations are quite specific to each scanner and 

FIG. 14 is an illustration of a typical dialog for data entry transducer as per tables Scanner Information 3 and associ- 

of expected ultrasound scanner performance parameters of ated Transducer Information 4. 

the present invention in operation. The processing of the image covers the significant aspect 

FIG. 15 is an illustration of a typical dialog for data entry of me invention. The processing of the test objects FIG. 5 

of permissible accuracy or deviation of the expected ultra- 30 contained in phantom images is illustrated in FIG. 2. Setup 

sound scanner performance parameters of the present inven- parameters for processing each class (type) of objects such 

tion in operation. as P* ns > cvsts or tumors roay consist of any one or a 

FIG. 16 is a hardcopy output of a typical ultrasound c <^ination of pre-configured values 22, operator adjust- 

scanner performance report produced using the present able * usm * a 8 p * hlc us f ace 142 / V0 J ce ****** <* 

invention in operation 35 any other computer peripheral input such as keyboard, pen, 

^ etc., or data dependent adaptable programmed setup 24. 

DETAILED DESCRIPTION OF THE Processing of objects consists of three modes such as 

INVENTION scanner performance parameters evaluation 27 for a particu- 

rn. * *. • ™^ -i iar image 140, calculations to produce performance report 

inepresentapparatusm^ 26, 150 from all images of a test, and computations involv- 

from scanner either by analog mode or digital mode. ing seyeral ^ rf ^ same scanner equ £ ment configura . 

Analog mode involves digitizing the video output 211 ti on 25 to analyze trends 163, 154 of any performance 

from scanner using video frame grabber or analog to digital parameters over a period of time. From any one of these 

converter hardware 204 and the digital image is transferred processing tasks, numerical results display 32, and 30, or 

to memory of computer 207. 45 X2A computation of graphs 31, 29, 28 and display of graphs 

In digital mode of image acquisition, digital output 213 of 35, 34, 33 or 123, 144, 154 are provided. Any of these are 

the image information from the scanner's memory, with accessible from evaluation dialog window 126, 152 or other 

appropriate protocol, is read into processing computer set list window FIG. 13. All windows provide help button to 

memory via digital Input/Output port 205 of computer 207. explain objects in the window and on-line help accesses all 

After the image of phantom objects is received into 50 definitions, descriptions, procedure explanations, and "How 

computer memory, the image is processed under user's To ... " accomplish a particular operation. Help is also 

control, producing numerical results, graphs, and reports accessible by pressing Fl key. 

automatically with specially designed and implemented The important features of the present invention include (i) 

algorithms. The results, graphs and reports are displayed on methods and implementation of calculation of test object 

display 206 and can be printed using printer 210 connected 55 parameters as in 51-58 (ii) procedure, implementation and 

to computer. The display subsystem 206 can be a CRT display of direct and derived parameters in graphs, (iii) 

(cathode ray tube) monitor, or any of a variety of screen implementation of analysis of trends from different sets of 

displays (such as Active or Passive Matrix) used with laptop, measurements (iv) interactive and pre-configured adjust- 

notebook, or sub-notebook computers. User communicates ments of parameters (v) automatic and manual reports using 

with processing computer 207 usually with mouse or track- eo expected values of parameters and permissible range of 

ball 209 and keyboard 208. The processed or unprocessed value deviations. Features, advantages and applications of 

images can be sent to video printers or video film camera, the present invention will be apparent to those skilled in the 

available in the market, using video output 212 from video art from a careful reading of the detailed description pre- 

frame grabber 204. sented below and accompanied drawings, formulas, defini- 

The information inputs to the apparatus are displayed in 65 tions and examples. 
FIG. 4. The outputs from the apparatus are given in FIG. 6. Calibration 51 of vertical and horizontal distances are 

Image processing architecture is presented in FIG. 2. The performed in axial direction 111 and lateral direction 112 
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relative to the scan surface 115. Distances are calculated this could depend on a number of parameters such as depth, 
from user inputs, preset values or prestored values of unit sector angle or horizontal position, tissue material, trans- 
relationship in each direction for number of pixels per unit ducer frequency, TGC controls etc. The standard deviation 
distance (cm, mm etc.) giving slope and an image (pixel) a u is given by 
position where absolute value is given to specify intercept 5 

The calibration is done for each image, or values from any C(/ = \| £(<;g> _ ^ pyf/(N - 1 ) — (equation 2) 

set can be used for other or all images by user prompt u 

without need for calculation for every image. for ^ (x y) in ^ computational ^ included in the 

Evaluation of uniformity object 52 consists of basic rectangle, 

method for analyzing test objects in following steps: (i) 1Q Depth refers to the vertical distance measured in an image 

select an area of interest in image, in which there are no test me calibration in the axial (beam propagation) direc- 

objects (this is referred to as background) and which covers tion from the t of me phantom or scan surface, 

as much vertical distance and horizontal distance as ^ me calculated values for each image are stored in 

possible provided by user input, pre-configured, or object classes ^ ical hg assodated with ^^ty 

prestored, (example 128, selected rectangular shape for 0D - ec t are* 

vertical pins in operation) and (ii) select a suitable cell size 15 , * ^ ~. 

in terms of number pixels and center for calculating « Mean Wlth res P ect to De P m Wlth OTOT bars 

weighted mean and standard deviation as per formula given displayed by ±o u and 

below or any equivalent method. Several variations of (ii) Sigma Ratio o £ Xd)/<g(d)> c/ with respect to Depth d. 

implementations are possible using various computational These values are computed to provide instant display of 

cell dimensions depending on the frequency of ultrasound 20 results. 

transducer, material of the phantom (tissue characteristics) Uniformity object is computed in axial 111 and lateral 112 

and weighted mean of pixel gray values inside the compu- directions. Results from uniformity object are used to detect 

tational cell using different weighting schemes. other objects. 

A two dimensional grayscale image consists of discrete Vertical pin objects are designed vertically down from the 

picture elements called pixels arranged in columns and 25 scanning surface to evaluate image properties in the direc- 

rows. Each pixel in image has a grayscale value, a specific tion of the beam or axial direction 111 as in FIG. 5. The 

discrete shade value between black and white. Gray shade scanned image appears in operation as displayed in FIG. 7 

value of a pixel is referred to as gray value. Mean gray value with vertical pin objects marked 128. These pin objects in 

computed for a number of pixels in a selected region is phantom images are brighter than the background or the 

called mean gray. Statistical fluctuations of gray values of 30 kvd of these objects m m her man ^ uniform 

STme^^ background gray level Usually, the diameter of these 

o mean gray. ^ objects are (about 0.3 mm-0.1 mm) considerably smaller 

Evaluation of ^uniformity -52 characteristics fields for a ^ the reso i vab ie object diameters or axial 

given phantom design fluctuations in gray value and mean resoJution of jca , m objects W2 

gray value at different depths within a selected region, in the „ a* i + i * u 

direction of the beam 111 or at different positions in the 35 P rocess «| "> evaluate several performance parameters such 

direction perpendicular to the beam 112. In practice, this is f P ln ^ widm 1*5 pin-to-pin distance 

essential to assess total image noise, including that of 101. and pm depth 1W. Evaluation 53 of vertical pin objects 

scanner electronics and transducer signals. Drifts and flue- uses res " lts t 10 ™ "f*™*? calculations 52. Object detec- 

tuations of gray values inimage performance can be quickly tion 1S based on object settings 142 or setup parameters as 

assessed with the present procedure and appropriate correc- 40 permetnods 22-24. • 

five actions can be taken. An important consideration here is Horizontal pin objects 103 are designed parallel to the 

that the uniformity parameters are calculated and displayed f canmn S surface «° ty ^ ute . * e Properties in the 

in graphs for all the depths or horizontal positions of the f or Pedicular direction to the scanning beam, 

phantom. Thus, any nonlinear electronic variations are iden- Usually * e ° umber °{ honzonta^ pins are fewer than 

tillable. Unless there is an enormous change in fluctuations. 45 v u ertlcal P ms " Ver * cal and h °rjzontal Pf ■« scanned from 

it is not possible to identify this problem with the current the same face and u the una 8 e ^ dudes ^ <* P 1 * 5 " ^ 

qualitative Quality Assurance (QA) procedures. When films some phantoms, there may be sets of horizontal pins at 

are used for visual evaluations, film recording method itself scv if ? s ,' . j . , 

may modify the image uniformity. If grayscale fluctuations These pmobjerts are designed across at fixed depths from 

in image increase, degree of visual definition of image 50 f he scanmn 8. surface . t0 evaluate image properties in the 

objects decreases. If grayscale fluctuations decrease, image ** ectl ° n - Horizontal pin objects in phantom images 

objects are smoothed out reducing the ability to identify ^ brighter than the background or the mean gray of these 

small objects or spatial resolution. Any variations from Me hl *« ^ * e mean background gray. Usually 

baseline performance requires attention. In clinical images duun « er °[ *** ob J e f m t ( about 9 1 ^ cons,der " 

this situation could affect the diagnosis. 55 ^ smai \ a . * e *»* resolution of typical scanners 

Ti « . , r . , . , , . Horizontal pin objects 103 are processed to evaluate several 

Let us denote vertical or axial (or ultrasound beam) r J . L • l^l-uia^ • 

- j i * * j • ^. v -rf. i / performance parameters such as pin object height 104, pin 

direction with y and lateral direction with X, orthogonal to ^ ia* ■ * • j- * J M A - . JL* 

, j ^ n ^ . * . * * width 105, pin-to-pin distance 106, and pin depth 109. 

beam direction, following x-y Cartesian coordinate system. „ , ^ I A c „ . * i • 

t , - . . Evaluation 54 of Horizontal pin objects uses results from 

• .^^u agrayscal e^buuon of the image at any M uniformity calculations 52. Object detection is based on 

pixel P(x.y) . the mean value of the gray value of uniformity ob - setti U2 or parameters as per methods 

object <g> (/ is calculated as 22-24 

<g>iy=^{U(x,y,p)W(p)yN ■ (equation l) Analysis of vertical 53 and horizontal 54 pins in image 

yields (i) measurement of pin distance and spacing between 

for every pixel included in the denned region where N is 65 imaged pins in axial 101 and lateral 106 directions to verify 

the total number of pixels and W(p) is a normalized accuracy of scanner electronic caliper measurements, (ii) 

weighting function; minimum resolvable object sizes or diameters 120 in each 
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direction for whole depth or horizontal positions of the tic clinical investigations. Evaluation of cyst 55 and tumor 
phantom, (iii) mean grayscale of objects, (iv) fluctuations of 56 is important to understand clinical imaging capability in 
grayscale within pin objects, (v) ratio of fluctuations to mean terms of geometry, contrast, and noise. Processing of cyst 
gray value of objects, (vi) area of objects in each direction and tumor objects offers following results: (i) Diameters of 
for whole depth or horizontal positions of the phantom, (vii) 5 objects in axial and lateral directions, (if) Ratio of axial 
extent of object edges 121 in each direction for the whole diameter to lateral diameter for each object, (iii) Area of 
depth or horizontal positions of the phantom, and (viii) ratio each object in each direction, (iv) Mean gray and fluctua- 
of pin objects mean gray to mean gray value of background tions from mean gray of each object in every direction, and 
giving how well pin objects are imaged with respect to (v) Ratio of fluctuations to mean gray for every object in 
background. io each direction. Advantages of the above performance char- 
Benefits of the above results are several fold: (i) Verifi- acteristic are to achieve: (i) Quantitative estimate of shape 
cation of scanner differential distance calibration throughout asymmetry, (if) Relative variations of object mean gray in 
axial and lateral positions, which is important for clinical relation to predesigned reflectance parameters, in other 
size measurements. Without the present apparatus this mea- words, how well relative reflectance are imaged in terms of 
surement is not feasible for scanners in operational envi- 15 grayscale, and (iii) Object "noise" or fluctuations, 
ronments. (ii) Systematic analysis of object diameters and Baseline values for each transducer and scanner combi- 
edges at different depths or horizontal positions permits nation can be established by initial measurements and devia- 
understanding or verification of important physical param- tions can be monitored for corrective action. If a manufac- 
eters such as scanner spatial resolution and focal zone. It is turer can provide 'factory" values of the parameters, using 
well known that spatial resolution of ultrasound scans are 20 these as baseline values, measurements at the installation 
different in axial and lateral directions. Object diameters and site can be verified. Periodic performance measurements can 
edges vary with depth and horizontal position. The calcu- be compared against installation baselines. Any appreciable 
lated values are displayed in graphical form as 123 in deviations can be corrected by service engineering and 
operation. By inspecting this graph or other graphs readily performance baseline levels can be restored. Thus, this 
available to user, any deviations from normal results or 25 invention helps scanner imaging performance to be main- 
abnormalities of performance can be identified and neces- tained in a reproducible manner. In addition, complete 
sary action can be taken immediately. By noting that the documentation is produced, test data saved and long term 
object diameters and edges are minimum at the focal zone, trends of scanner performance parameters are also available 
scanner's focal zone settings can be verified from viewing automatically for inspection. 

corresponding graph 123. (iii) Systematic examination of 30 Detection is implemented based on pixel gray value, 

object mean gray provides insight into power attenuation rninimum required size of object, and other parameters 

with depth and behaviour of gain controls. Ratio of object based on tissue characteristics. Algorithm for object detec- 

fluctuations of grayscale to mean gray value, yields gain tion is given below. 

independent parameters. This graph depicts object "noise" For bright objects such as vertical pins, horizontal pins, 

to object signal ratio. Any spurious deviations observed 35 and tumors, find object such that pixel gray value P(x,y,p) 
from these graphs indicate imaging system problems or 

drifts warranting action. Best fit curve drawn in graph is P(*,y,p)£^gv+-n.c t ,; (equation 3) 
helpful in pinpointing the variations easily, (iv) Systematic 

inspection of ratio of object mean gray value to background For dark objects such as cyst, find object such that pixel 
mean gray gives a measure of contrast of object against 40 value p ( x > v >P) 
background under same scanning conditions. Object con- 
trast is fundamental to the purpose of image scanning for *w)S<»>ir«.°v; (equation 4) 
detection of objects and diagnosis based on image. whefe fa 

The present invention provides these insightful results auto- ^. 7nn , Q , , . . A . . , ^ „ - 

maticallv horizontal extent or extent m the lateral direction 112 or 

value of tissue characteristics o 

Vertical and horizontal pin diameters in phantom must be A - . . , . . . ' . WJ - 

appreciably smaller than resultant object image diameters 50 nh ^lfw T St f ndard ^ Um calculated for all 

for the above considerations. As the scanner technology ph ^° m SUCh * S ^ 5T' *~**I™>«y**> 

improves, pm image object diameters would become smaUeV ^ USm %?™}T\l u • • ■ • ,™ 

requiring different pin designs. It is noticeable, from image . ^ V ^J e f P r< f e °W * the object m axial direction 130 

in example 128, pin objects become elliptical indicating " <™*P*ed tiie object by summing pixel gray values m 

object diameters are different in axial and lateral directions. 55 orthogonal direction 

Lateral diameter of pin is larger than or equal to axial n/vty w „ vn , • • , . . # , ^ cx 

a- * iv , . _ A . . ~ . , ^ , 4 . Gty^i^x^p) inside the object. (equations) 

diameter. Pin objects in phantom are circular by design. 

Thus it is evident, object image shape obtained by scanning Distribution using equation 5 gives axial line spread 

is not exact representation of original object This charac- function of the scanner. Functional dependence of p is 

teristic is important in evaluation of cyst and tumor objects. 60 omitted for simplicity. 

Cyst (anechoic very low reflectance objects or darker Q^y value profile of me o5ject ^ ^ lM 

than background) 300 and tumor (echoic, brighter than direction is written as 
background or very high reflectance objects) in phantom are 

designed with criteria that their sizes are considerably larger g(x) inside the object. (equation 6) 

than pin image object diameters. These phantom objects are 65 

designed to produce different preset reflectance at a particu- Distribution using equation 6 gives lateral line spread 

lar ultrasound frequency. These simulate objects of diagnos- function of the scanner. 
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Object height h^lY^-YJ (pin center) yields axial distance accuracy within the scan 

where at depth. A graph horizontal pin distance 106 with respect to 

depth (pin center) yields lateral distance accuracy within the 

y=Y3Q and y=Y_ the value G(y>=G (I1(lrtMf /2.0 (equation 7) scan width. 

5 Using calibration values and object analysis as described 

^Obiect heieht h HY -Y I where at v-Y and v-Y above ' object object mean ^ and standard deviation 

Object neignt n 10 -i y + y j, wnere at y= y + ana y= y m calculated for every o5ject Disp iay graphs are provided 

o^y^^^^^^yjo.o (equation 8) w ^ respect to object depth for vertical pin object area, and 

vertical pin object mean gray, with standard deviation from 

Object width W^IX^-XJ 10 mean gray of the object The area of the object is obtained 

where at x=X_,_ and x by counting the number of pixels inside the object boundary 

and multiplying by calibration factors. 

=X_ the value Q^y^ mamtm J2S) (equation 9) From mese va j ues? rat i 0 0 f pin object mean gray to 

Ob* ct idth W -IX* -X* I background (uniformity) mean gray at that depth, is evalu- 

. ^ + 15 ated. This ratio represents a performance parameter related 

w ere ax- + an to con^t ^ independent of the operator settings of 

x=X-_ the value G(x>=G martmin /lO-0 (equation 10) me scanner such as power, TGC etc. Another deduced ratio, 

of standard deviation to mean gray of the pin object is 

The values h 2 and W 2 are referred to as Full-Width-Half- evaluated as well. This ratio is a measure of object "noise" 

Maximum (FWHM). The values h xo and W 10 are referred to 20 to object signal for the pin object. Graph of this ratio for 

as Full- Width-Tenth-Maximum (FWTM). Axial diameter of objects at different depths depicts depth dependence of 

object is given by h 2 and lateral diameter is W 2 . object noise. 

Object edge is defined by e A =h 10 -h 2 in axial direction and These values are produced for each object and graphs are 

e z ,=W 10 -W 2 in lateral direction. Object is sharp and well produced for all parameters described for every depth as in 

defined in axial direction when c A ~Q. Profile calculation and 25 graph 123 or every horizontal position. Object contrast can 

parameters deduced from profile of ultrasound image objects be defined in several ways. The present invention enables 

is a basic component of the present invention. automatic evaluation and provides quantitative results for 

Using object profile, then following object characteristics objects at every depth for display and print out. 

are determined: (i) geometric center or centroid 113 or 114, The analysis described above is performed for vertical 

(ii) axial "diameter" or object height h 2 131 of the object 104 30 pins 102 appearing in axial direction 111 and horizontal pins 

as per equation 7 and lateral diameter object width W 2 105 103 in lateral direction 112. There is no restriction that the 

as per equation 9 and (iii) the object edges 134, 135 of the objects be aligned in any direction. Vertical pin objects 

object €. A in axial and c L lateral directions as per equation 8 produce graphs with respect to depth and Horizontal pin 

and equation 10 respectively. Currently marketed test objects display graphs with respect to horizontal position, 

objects are circular and we evaluate "diameters". However, 35 Objects are processed inside selected region in image. No 

present method of object analysis is designed for any object restrictions are placed on size or position of selected region, 

shape. Diameter in any designated direction is defined as a Processing procedure is not limited to a particular shape of 

distance between two points on the profile having a specific defining area, ie. rectangle as long as objects are inside. If 

ratio to the peak value on the object profile. We have, for objects are not detected, processing can be redone by 

specificity, used Full-Width-Half-Maximum (FWHM) 131 40 varying object settings 142 using setup 125. 

for diameter 120 as defined in equations above. Implement- The object parameters are analyzed using curve fitting 

ing edge calculation z A and is one of the important techniques (such as least squares) for finding and displaying 

features of this invention. Object edge (sum of 134 and 135) 122 systematic variations of performance characteristics in 

is displayed in typical graph 123 as a vertical line 121. every graph. Numerical results 124, for example, are also 

Equivalent calculations can be implemented either using 45 presented. 

profile or traditional edge enhancement and edge extraction With every menu or procedure, operational instructions 
procedures. The display of edge 121 and object height (axial 127 are provided on the screen to help user. More detailed 
diameter) or object width 120 (lateral diameters) with depth Help is typically accessible through button 129 in each 
of the object demonstrates systematic behaviour of spatial dialog, by pressing Fl key or accessing Help menu. Auto- 
resolution the scanner. Thus, the calculation and display of 50 matic operational instructions 127 integrated with opera- 
edge 121 in a typical graph 123 is another key feature of the tional menu or dialog, together with context sensitive Help 
present invention. Several performance interpretations are buttons 129, are user interface aspects of the present inven- 
derivable from profile evaluation and extraction of "diam- tion. 

eter" and "edge" information through equivalent methods to The above description applies to evaluation of vertical 

achieve similar results and display. The edge and diameter, 55 and horizontal pins. Typical evaluation menu in operation is 

together, are important in establishing focal zone of the presented in 162. From above calculations and results, 

transducer, in terms of numerical results and graph display performance parameters axial resolution and lateral resolu- 

123. This feature is an important result of this invention. All tion of ultrasound scanner are evaluated for report produc- 

graphs are produced for visual display on screen, printout on tion. 

paper or film, or digital export to other programs. Perfor- 60 Several equivalent definitions for axial resolutions are 

mance characteristics evaluation the following pin and hori- possible, all depending on the spatial extent of the object in 

zontal pin objects are described in the following paragraphs. axial direction, minimum or mean. Basically, this parameter 

Distance calibration accuracy is calculated in axial direc- defines ultrasound scanner's ability to detect and clearly 

tion 111 as vertical inter-pin distance 101 between centers of display closely spaced objects that are placed in axial 

adjacent pins 114 and in lateral direction 112 as horizontal 65 direction. Axial resolution is determined by identifying the 

inter-pin distance 106 between centers of adjacent pins 113. closest two pins designed for axial resolution determination. 

A graph of vertical pin distance 101 with respect to depth Smallest separation between pin objects that can be per- 
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ceived at each depth is recorded as the axial resolution. Pin deviation of tumor mean gray to tumor mean gray value for 

objects are considered separate when a dark line is seen each object, with respect to depth and lateral position are 

between them as displayed. provided for inspecting imaging performance of tumor 

The above definition applies to visual identification of objects, 

objects and does not take into account gray scale variations 5 All calculated parameters from each image for each 

(profile) of pin object from end-to-end in axial direction. We transducer per measurement set are stored for further analy- 

have extended this definition to estimate precisely the sis and preparation of reports. To produce reports, results of 

"diameters" in axial and lateral directions using the charac- calculations from all images of a set of measurements are 

teristics of the pin objects. Our method produces numerical used. Typical report dialog in operation is illustrated in 150. 

results automatically, which is a fundamental aspect of this 10 Data for every transducer for the scanner is accessible by 

invention. using combo-dialog 151. Distance accuracy values are 

The axial resolution is calculated as the mean value of all included in report. If processed values fall outside the 

vertical pin heights h 2 from all images for the transducer in phantom (design) performance values FIG. 14 and perfor- 

a particular set. The axial resolution from other methods mance parameter limits FIG. 15, an asterisk is placed 

may provide slightly different values. The evaluation 15 automatically to indicate the unacceptable performance 

method applied here provides a mathematical basis for score. Similar indication is provided in Typical Ultrasound 

establishment of consistent baseline values and compari- Scanner Performance Report illustrated in FIG. 16. Axial 

sons. and Lateral resolutions are calculated, as per definitions, 

Lateral resolution defines the scanner's capability to dis- using all images for each transducer of the set Graphs for 

criminate adjacent objects perpendicular to the axial direc- 20 pin heights and widths including data from all images are 

tion. Lateral resolution is evaluated by measuring the width accessible by clicking typical graph buttons 152. These 

of pin objects W 2 at different depths (near, mid or far field graphs are quite different from graphs available from 

zones of the transducer). Currently, calipers available with evaluation/results dialog 126 which include results from 

scanner are used to measure the width of a pin object in the only one current image. Report for the transducer includes 

focal zone based on the visual display associated with the 25 mean value of ratio of cyst height to width for all cyst 

scanner. This current method is subjective and does not lend objects, mean value of ratio of tumor height to width for all 

itself, to precise measurement. With this approach, it is not tumor objects, and mean value of pin objects mean gray to 

practical to measure widths at different depths. The present uniformity object mean gray value. Each of these parameters 

invention permits quantitative and automatic evaluation of have associated graphs from results of all images, 

heights and widths for every object in image. 30 Dead zone sketched as 110 in FIG. 5, is the vertical 

The lateral resolution is calculated as the minimum value distance down from scan surface, no useful image informa- 

of all vertical pin widths W 2 from all images for the tion is seen. Dead zone is a result of interface between 

transducer in the particular set. The variation of width with transducer and phantom material. Dead zone 57 is evaluated 

object depth is displayed in a typical graph in example, using operator input and distance calibration values, for any 

Vertical Pin Width vs Depth graph 123; the edge value is 35 number of images. Dead zone parameter in report is maxi- 

drawn as a vertical bar from value of diameter. It is observed mum of all values from images of a set. This value of depth 

from measurements that object edges in lateral direction are represents the minimum depth from which useful image 

usually considerably higher than in the axial direction. information can be extracted This value can be different for 

Cyst objects 300 are anechoic objects producing pixel different phantom models or manufacturers depending on 

gray values lower than mean gray of uniformity objects. 40 the material medium. 

Object detection is performed using equation 4. Usually, Penetration Depth 107 in FIG. 5, is the maximum depth 

cyst objects are larger in size than pin objects. All parameters beyond which no useful image information is available. Due 

evaluated for pin objects are computed for cyst objects. In to attenuation ultrasound waves in the medium beyond this 

addition, ratio of height to width (or axial diameter to lateral depth no echo is received. Penetration Depth 58 is evaluated 

diameter) of objects is also available as a measure of 45 based on user input and distance calibration values, for any 

performance. number of images. Penetration Depth parameter in report is 

Cyst objects provide graphs of ratio of height to width arrived at as the minimum of all values from images of a set 

with respect to depth and with respect to position to indicate This value represents the maximum useful depth from the 

the imaging capability of the scanner in terms of object scanning surface. This value can be different for different 

geometry. This is important for clinical size measurements. 50 phantom models or manufacturers depending on the material 

Graphs, for cyst area, mean gray, and ratio of standard medium. 

deviation to cyst mean gray for each object, with respect to The vertical distance from dead zone to penetration depth 

depth and lateral position are provided for instant under- is useful scan depth range 108 within which all objects of 

standing of imaging performance of cyst objects. scan should be placed for any useful scan information. These 

Tumor objects are echoic objects producing pixel gray 55 parameters are significant in that the deviations affect visu- 

values higher than mean gray value of uniformity objects. alization of clinically useful diagnostic object placements. 

Object detection is performed using equation 3. Usually The vertical distance from Dead Zone to Penetration Depth 

tumor objects are larger in size by design than pin objects. gives the clinical depth range. Any variations in the depth 

All parameters evaluated for pin objects are computed for range require close inspection. 

tumor objects as well. In addition, ratio of height to width (or 60 One more parameter included in the report is a subjective 

axial diameter to lateral diameter) of objects is also available operator assessment of scan uniformity or scan quality 153 

as a measure of performance. by user entry into combo-edit box or select on of precoded 

Tumor objects provide graphs of ratio of height to width words such as Excellent, Good, or Poor, 

with respect to depth and with respect to position to indicate A significant aspect of report dialog 150 in operation, is 

the imaging capability of the scanner in terms of object 65 that the values are automatically produced except user 

geometry. This is important for clinical size measurements. assessment of Scan Uniformity 153. In addition, in circum- 

Graphs, for tumor area, mean gray, and ratio of standard stances when no acquired images are available, the user can 



5,689,443 

13 14 

enter values manually as well, if necessary. Thus, report 2. The apparatus of claim 1, said software means further 

dialog 150 permits manual and automatic entry of values. interactively allows for selection of a region in image with 

This facility is another practical feature of the present said phantom test object for analysis, 

invention. 3. The apparatus of claim 1, said software means further 

Automatic printed version of report 157 is enabled using 5 interactively allows for setting object processing parameters 

Print button and typical report is illustrated in FIG. 16. Date an ^ limits for analysis. 

of report production, reporter's name, date of measurement, 4 ^ apparatus of claim 1? wner ein said output device is 

name of measurement performer, Scanner related a nrij^ej. 

information and parameters with test score (note for s.The apparatus of claim 1, wherein said output device is 

asterisk) evaluated for each transducer are pnnted. 10 a dis la screen 

Analysis of Trends is illustrated via graph 154 in opera- * * «^ j " * ^ ^ i , ^ . 

—J j * r_ i**- * 6. A method of quantitatively evaluating image quality 

uon. The data from several sets of previous measurements t . . * , * . . «_ 

by dates 155 for the same scanner and transducer combina- charactenstics of an ultrasound scanner, comprising the 

tion is analyzed to produce trend evaluation of the param- steps of : 

eters over a period of time. The values 156 are analyzed is (a) selecting a phantom test object within an image; 

using curve fitting techniques (such as least squares) to (b) quantitative processing of said image to evaluate 

display deviations and direction of variation. Trend Graphs, image quality 

useful for insight, documentation and service are also a key characteristics of the scanner for diagnostic purposes; and 
aspect of the invention. Trend Graphs for all report param- 
eters are accessible from Trend menu 163 in operation, 20 < c > outputting results of the quantitative processing, 
accessible from any trend graph and trend button. 7 - 111(5 method of claim 6, wherein said step of selecting 
Images are accessed from database elements specific to an image involves selecting a region of said phantom test 
particular scanner, transducer, and measurement set; within object. 

the same measurement set, data of other transducers for the 8. The method of claim 6, wherein said quantitative 

same scanner is accessible. From any graph 144, other 25 processing includes evaluating object profile of said phan- 

graphs 145 related to the same object measurements are tom test object in axial and lateral directions. 

accessible. Inter-accessibility of scanner database, images, 9 - Th e method of claim 6, wherein said quantitative 

graphs and report and trends is a basic aspect of the processing includes evaluating calibration. 

invention yielding a user friendly apparatus. 10- The method of claim 6, wherein said quantitative 

Typical image manipulations using Display Functions 30 processing includes evaluating uniformity, 

menu 160 in operation, for all images of a set are available H- The method of claim 6, wherein said quantitative 

from menu as illustrated. Individual image manipulations processing includes evaluating vertical pin objects, 

are also possible with menu such as 161 in operation, from 12- The method of claim 6, wherein said quantitative 

each image. Other display functions (different image for- processing includes evaluating horizontal pin objects, 

mats such one, two, eight, magnification both fixed and 35 13. The method of claim 6, wherein said quantitative 

variable) lending to user desired viewing of images. processing includes evaluating cyst objects. 

It will be apparent to those skilled in the an that many 14. The method of claim 6, wherein said quantitative 

changes and substitutions, in definitions, equations, method, processing includes evaluating tumor objects, 

implementation, user interface, display or report, can be I 5 - The method of claim 6, wherein said quantitative 

made to the present invention without departing from the 40 processing includes evaluating distance accuracy in axial 

spirit and scope as defined by the appended claims. an< * lateral directions. 

What is claimed is: 16- The method of claim 6, wherein said quantitative 

1. An apparatus for quantitatively evaluating image qual- processing includes evaluating dead zone and penetration 

ity of an ultrasound scanner, comprising: depth. 

a processor 45 T * ie metno< * or " claim 6, wherein said outputting the 

* . analysis includes the compliance of processed results with 

a storage device; stored performance standards. 

at least one output device; 18. The method of claim 6, wherein said outputting the 

at least one input device; and analysis includes trends of processed results from several 

software means operative on the processor for: 50 sets of tests - 

(a) niaintaining in the storage device information on the 1^- The method of claim 6, wherein said quantitative 
scanner* processing includes evaluating at least one of: 

(b) maintaining in the storage device information (a) said phantom test object diameter in axial and lateral 
regarding expected performance standards; directions; 

(c) maintaining in the storage device information 55 (5) phantom test object edge in axial and lateral 
regarding at least one phantom test object; directions* 

(d) inputting via said at least one input device; (c) saM hantom test object cent£r; 

(e) interactively specifying said at least one phantom , ^ . , , 

test object in image for processing; < d > said P hantom test ob J ect 

(0 processing said specified phantom test object in 60 ( e ) said phantom test object mean gray value; and 

image to quantitatively determine image quality (f) fluctuations in said phantom test object mean gray 

characteristics of said scanner to evaluate the scanner value. 

for diagnostic purposes; ; , . 20. The method of claim 6, wherein said quantitative 

(g) maintaining in the storage device results of said processing includes evaluating distance between said phan- 
processing; and 65 tom test objects in axial and lateral directions. 

(h) outputting via said at least one output device results 

of said processing. ***** 



